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We present a general and flexible procedure which allows for the reduction (or expansion) of any 
dynamical network while preserving the spectrum of the network's adjacency matrix. Computation- 
ally, this process is simple and easily implemented for the analysis of any network. Moreover, it is 
possible to isospectrally reduce a network with respect to any network characteristic including cen- 
trality, betweenness, etc. This procedure also establishes new equivalence relations which partition 
all dynamical networks into spectrally equivalent classes. Here, we present general facts regarding 
isospectral network transformations which we then demonstrate in simple examples. Overall, our 
procedure introduces new possibilities for the analysis of networks in ways that are easily visualized. 



PACS numbers: 89.75.-k,89.75.Fb,05.45.-a 

Many, if not the majority of networks that occur in na- 
ture are very large in the sense that they contain many 
nodes and many edges [TH3]- A considerable number 
of these networks (neural networks, metabolic networks, 
power stations, etc.) are also dynamic, i.e. each node 
has an associated state that changes in time according to 
its intrinsic evolution and interactions with other nodes. 

Because of the complex structure of most real-world 
networks there is a strong motivation for developing 
methods that simplify the topology of a network while 
maintaining some of the network's basic characteristics. 
In this regard, perhaps, the most fundamental charac- 
teristic of a dynamical network is the spectrum of its 
adjacency matrix [H [5]. In a dynamical network each 
edge of the graph of interactions (topology of a network) 
can be assigned a weight related to the strength of the 
corresponding interaction. In practice, such edge weights 
typically represent the linearization of the associated in- 
teraction. These weights make up network's weighted 
adjacency matrix which forms the backbone of any dy- 
namical network. An important question then is how and 
to what extent can a network be simplified (reduced in 
number of nodes and edges) while preserving the spec- 
trum (eigenvalues) of its adjacency matrix. 

At first it may seem that both simplifying (i.e. re- 
ducing) a network and maintaining its spectrum is not 
possible. One obvious issue is dimensionality. Indeed, 
a network with n nodes has an n x n adjacency matrix 
so reducing a network to m < n nodes would seem to 
necessarily reduce the number of eigenvalues associated 
with the network. However, despite this and other pos- 
sible complications we will demonstrate that it is in fact 
possible to do just this. 

The process of isospectral reduction, which we propose, 
moreover allows for the introduction of new equivalence 
relations between dynamical networks where two net- 
works are equivalent if they can be isospectrally reduced 
to the same network. This procedure is also quite flexible 
as it is possible to reduce a network to a smaller network 
on any nonempty subset of its original set of nodes. Our 
procedure, therefore, allows one to reduce a network with 



regard to characteristics such as centrality, betweenness, 
clustering, etc. [3 e.g. over nodes with maximal central- 
ity In this respect, the method of isospectral reductions 
allows experts (e.g. physicists, biologists, chemists, engi- 
neers, etc.) to reduce (simplify) the dynamical networks 
with which they are concerned relative to any network 
characteristic they find interesting while preserving the 
network's major dynamical characteristics. 

Additionally, this approach to network analysis is vi- 
sually informative as one can directly see and compare 
various reductions of the same network or reductions of 
different networks. Also, if one wishes to reduce edges 
instead of nodes one need only interchange nodes and 
edges and perform the same operation. 

As a dual procedure we similarly demonstrate that one 
can enlarge (rather than reduce) a dynamical network, 
thereby making it more sparse, while again maintaining 
its spectrum up to a set known in advance. Here, as 
in the case of isospectral reductions, this collection of 
eigenvalues is immediately known from the topology and 
weights of the network. 

Our results on isospectral transformations are charac- 
terized by two important features. First, these results 
can be rigorously proven (see [6]). Therefore, we refer to 
them here as Facts. Second, our procedure is algorith- 
mic and importantly easy to implement. Therefore, the 
major goal of this paper is to present the network com- 
munity with a new and flexible tool for the analysis of 
dynamical networks which could be immediately put to 
use in the study of real networks. The only information 
needed to carry out this procedure is the topology of a 
specific network. 

In this paper, every network is described by its set of 
nodes (vertices) V, directed edges E, and weights w(e) 
of the edges e. Thus, a dynamical network is identified 
with a weighted and directed graph G = (V,E,uj). An 
edge from vertex V{ to Vj is denoted by . The weighted 
adjacency matrix of G is given entrywise by M(G)ij — 
uj(eij). The spectum tr(G), or the collection of eigenvalues 
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FIG. 1: The graph G (left) and its reductions over S = {«i,«3} (center) and T = {^2,^4} (right) where each spectrum is 
indicated. Here all edge weights of G are equal to 1. 



of M(G) are the solutions to the equation 

det(M (G) - XI) = 0. (1) 

Our procedure allows edge weights of a network to be 
maintained under reduction if all are equal to 1 (i.e. if 
a network is unweighted) or weights to be positive num- 
bers, etc. However, in the most general case edge weights 
are allowed to be functions of the spectral parameter A in 
equation ([I]). Various examples will be presented below. 

Of primary importance is the fact that a typical net- 
work G cannot be reduced over an arbitrary subset of 
its vertices by means of a single reduction. Instead, a 
network G can be reduced over any arbitrary subset of 
its vertices via a sequence of isospectral reductions where 
each reduction is achieved by reducing over a particular 
subset of the network's vertices. Such subsets are called 
structural sets and are described as follows. 

First, we remove all loops (closed paths containing a 
single vertex) from G and denote the remaining graph by 
((G) . A subset S C V is a structural set of G if there are 
no closed paths in ((G) on S — V — S and ui(eu) 7^ A for 
each Vi £ S. For example, in Fig. 1 the vertex sets S — 
{i>i, V2} and T = {v^, V4} are structural sets of G whereas 
{^17^3} is not. From a computational point of view it is 
straightforward to determine, for a given network, which 
subsets of its vertices are structural sets and which are 
not. The formal procedure (algorithm) for isospectrally 
reducing a graph is as follows. 

A path in a graph G = ( V, E, uS) is an ordered sequence 
of distinct vertices Vx, ... ,v m such that e^+i are edges 
in E for each 1 < i < m — 1. The interior vertices of 
a path are the path's vertices except the first and last. 
For a structural set S — {v\, . . . , v n } let Bij(G; S) be the 
collection of all paths from to Vj for 1 < i, j • < n which 
contain no interior vertices in S. Now consider the union 
of such paths over all pairs Vi and Vj given by 

B S (G)= |J B^G-S) (2) 

l<i,j<n 

An isospectral reduction of G = (V, E, w) over the struc- 
tural set S = {vi,...,v n } is the network lZs(G) = 



(S, £, /i), where there is an edge € £ between Uj and Vj 
of S if and only if there is at least one path in Bij(G; S). 
If Cij € S then e,*j has weight equal to 

A*(ey)= £ a/feu) n A _^) ( 3 ) 

where the sum is taken over all paths /3 = v%, . . . , w m . 

Fact 1 (Preservation of Spectral Information) 

The spectrum of a network G = (V, E, uj) is preserved 
when G is reduced over the structural set S up to the set 
o~(G, S) which is the collection of weights of loops of the 
vertices in S . Therefore, this set is known in advance and 
can be directly read from the initial network ( see theorem 
3.4 in J^). 

For example, in Fig. 1 consider the structural set S — 
{vi,V2}- Here, one can see that a(G,S) — {0,0} which 
is the difference between a(G) and a(TZs(G)). 

With the concept of an isospectral reduction in place it 
is natural to define an isospectral expansion of a graph G 
as a graph H where TZt(H) = G for some structural set 
T of H. Such expansions can be carried out by expand- 
ing edges into paths or multiple paths with the correct 
product and sum given in ([3]). 

Importantly, as a reduced network 1Z$(G) will have its 
own structural sets, it possible to sequentially reduce a 
network. However, given that different sequences of re- 
ductions seemingly lead to different reductions, a natural 
question then is whether one can have some sort of con- 
trol of the resulting reduced network in this huge variety 
of possible reductions. That is, by which sequence of 
reductions should one reduce a network to a smaller net- 
work on a particular vertex set that one finds interesting? 
As it happens, sequences of reductions have the following 
remarkable property which resolves this key issue. 

Fact 2 ( Commutativity of Sequential Network 
Reductions ) In a sequence of reductions order and num- 
ber of reductions do not matter. What matters is only the 



H H' T^{vi,v2}(H) =7l{ vliV2 y(H') 

FIG. 2: As 7Z.{ vl ,v 2 } (H) = 1Z{ v1iV2 }(H') the networks H and H' are spectrally equivalent. Here all edge weights of H and H' 
are equal to 1 and only the vertices of the structural set {i>i,t>2} are labeled. 



final subset of vertices over which the network is reduced 
(see theorem 3.5 in JEl). 

More formally this fact could be expressed in the fol- 
lowing way. Let the sets S m c 5 m _i c • ■ ■ C S\ C V be 
structural sets in a sequence of reductions on the graph 
G=(V,E,u). Then K(G; S u . . . , S m ) = K Sm (G). That 
is, regardless of the specific sequence of reductions over 
which the graph G is reduced to a graph on the vertices 
S m the result is always the same. 

Besides allowing one to simplify (reduce) a network, 
our procedure can also be used to establish new equiv- 
alence relations between different networks. Namely, we 
say two networks are spectrally equivalent if they can be 
isospectrally reduced to the same network. As an ex- 
ample, in Fig. 2 we show the two spectrally equivalent 
networks H and H' . However, note that even in this rel- 
atively simple example it is rather improbable that one 
would recognize this fact if it were not pointed out. As 
real-world networks are much more complicated the fol- 
lowing fact is quite remarkable and instructive on how to 
deal with networks of any type. 

Fact 3 (Network Equivalence) Choose a rule r that 
uniquely selects a subset of nodes r(G) C V of any net- 
work G = (V,E,u). Then the rule r induces an equiv- 
alence relation on the space of all networks in the sense 
that two networks G and H belong to the same equiva- 
lence class if they are spectrally equivalent under r i.e. 
K T[G) {G) = n T(H) {H) (see theorem 3.9 in Jd/). 

For instance, the choice of all vertices of a network 
with minimal out degree is a rule that selects a unique 
subset of nodes of any network. Conversely, the choice of 
an arbitrary vertex of a network is not. Here, it is again 
the role of the expert to choose a specific rule for analysis 
and comparison of concrete networks observing that the 
flexibility of our procedure allows for many such rules. 
For a natural starting point one could use well known 
network characteristics (e.g. degree, centrality, between- 
ness) to develop such rules. The only requirement is that 
such rules must single out a unique subset of nodes. 

So far in this paper we have considered network trans- 
formations in which the network's edge weights become 
more complicated as the network is reduced. It could be 
argued from this point of view that our procedure sim- 
ply trades network complexity for the complexity of these 
edge weights. However, this is not the case. 



Fact 4 (Isospectral Reductions Over Fixed 
Weight Sets) It is usually possible to isospectrally 
reduce a network while maintaining the network's set of 
edge weights. Moreover, only the number of zeros in the 
spectrum of G can change under such transformations, 
(see theorem 4-5 in J($) 

The procedure for reducing a network G — ( V, E, uS) over 
a fixed weight set is as follows. First, let S = {v\ ,...,«„} 
be a structural set of G with the restriction that each 
vertex of S has no loop. 

Step 1: For each path P = v±,...,v m in Bs{G) let 
7r(P) be the product of the edge weights along this path. 
Then reweight the edges of this path by giving the first 
edge of P weight tt(P) and the last m — 2 edges weight 
1. Denote the set of reweighted paths terminating at the 
vertex vj by 

nB j (G;S)= (J ^(G;5) (4) 

l<i<n 

where irBij (G; S) are the reweighted paths from Vj to Vj . 

Step 2: For 1 < j < n, combine the last interior ver- 
tex of each path in TrBj(G; S) to a single vertex leaving a 
single edge between this vertex and Vj of weight 1. Sim- 
ilarly, combine the second to last interior vertex of each 
path in this manner and so on until all interior vertices 
of paths in TtBj(G; S) have been combined in this way. 

Step 3: If the paths P x ,...,P h of nBij(G;S) are of 
the same length then in this construction there will be 
multiple edges between Vj, and these path's first interior 
vertices. In this case reduce these multiple edges to a 
single edge of weight X)i=i 7r (^)- The resulting graph 
is Cs{G). We note that the spectra a(G) and a(Cs{G)) 
are the same aside from a number of zeros. 

Now, suppose U is a so called unital ring [7], i.e. U 
is a collection of numbers that contain all products of 
these numbers and sums of these products as well as the 
number (unit) 1. If U is a unital ring containing all edge 
weights of G then each edge weight of £s(G) is in U. 
In this case we say Cs(G) is a reduction of G over the 
weight set U if Cs(G) contains fewer vertices than G. As 
an example consider the graphs J and Cs{J) hi Fig. 4. 

For applications, the most important reductions over 
fixed weight sets are the cases in which U is the ring of 
all positive numbers or the trivial ring consisting of the 
weight 1. When only the topology of a network is known 
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a{K) = {2, ±i,0} cr(X s (K)) = {2, ±i, 0, 0, 0, 0, 0} 

FIG. 3: For S = {vi}, Xs(K) is an expansion (sparsification) of K over the weight set {1}, i.e. the edge weight 1 of each edge 
is maintained. Here only the structural set S = {vi} is labeled. 



but not the weights, it is natural to assign each edge 
the weight 1. In this reduced network is again 

unweighted as each edge will have weight 1 (see Fig. 3 
where K is the reduction of X$(K) over U = {1}). 

Isospectral expansion over fixed weight sets always ex- 
ist if a network is not too simple (see Fact 5). This allows 
one to make the network sparser while maintaining the 
network's spectrum up to a known set. 

Fact 5 ( Sparsification of Dynamical Networks ) If 

a network has two cycles (closed paths) which are not 
loops but intersect in at least one vertex then such net- 
works can be made (sequentially) more sparse. This is 
done via an isospectral expansion that exactly maintains 
the network's set of edge weights and preserves the net- 
work 's spectrum up to a set of eigenvalues known in ad- 
vance (see theorem in JE/). 

This process is described as follows. For two paths 
P and 7 in Bs{G) we say these paths are independent 
if they share no interior vertices. An isospectral expan- 
sion of a graph G over its weight set is the graph X$ (G) 
in which any two paths of Bs(G) have been made inde- 
pendent. That is, to each path in Bij(G;S) there is a 
corresponding path in Bi 3 (Xs(G); S) of the same length 
and edge weights. 

To describe the extent to which the eigenvalues of a 
graph differ from its expansion let rij be the number of 
paths in Bs{G) containing v t . Then a(G) and a(Xs(G)) 
differ by n$— 1 eigenvalues of the form ui(eu) for all Vi G S. 
As an example, in Fig. 3 we show an isospectral ex- 
pansion Xg(K) of the graph K over its weight set {!}. 




J C S {J) 
a(J) = {3, -2, -1, 0} a(C s (J)) = {3, -2, -1} 

FIG. 4: For S = {vi} the graph £,s(J) is a reduction over the 
weight set of positive integers. Here only the structural set 
S = {ui} is labeled. 



Here, each additional vertex in the expansion X${G) cor- 
responds to an extra in its spectrum. Because Xs(G) 
is far more sparse than K we refer to X$(G) as a spar- 
sification of K. It is well known that there are various 
methods to analyze sparse networks. Our procedure al- 
lows us to make any network sparse. 

In conclusion, we have presented a rigorous procedure 
which allows one to transform a network to a simpler 
one with fewer nodes and edges while preserving the net- 
work's collection of eigenvalues (spectrum). Such reduc- 
tions can be used to establish spectral equivalence be- 
tween networks and can be carried out according to any 
criterion related to any network characteristic (degree, 
betweenness, etc.). This allows one to compare the reduc- 
tions of different networks and find similarities in their 
structure related to the chosen characteristics. This anal- 
ysis is moreover facilitated by the fact that isospectral 
reductions visually simplify networks. These results can 
be readily applied to any real network. Additionally, this 
procedure can be used on dynamical networks to obtain 
improved stability results (see theorem 6.8 in [5]). 
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